03. Linear Combination and Span

Linear Combination and Span- Theoretical Definitions

In general terms, the simple definition of a linear combination is a multiplication of a scalar to a variable and addition of those terms.

For example:

If
xx, yy and zz are variables,

and a1a_1, a2a_2 and a3a_3 are scalars,

the following equations will be a linear combination:

v=a1x+a2y+a3zv=a_1x+a_2y+a_3z

Equation 6

Let's now put it into the Linear Algebra context.

Our variables will now be vectors: x\vec{x}, y\vec{y} and z\vec{z} are variables.

The scalars can remain the same:
a1a_1, a2a_2 and a3a_3.

A linear combination of a scalar by a vector will be a new vector:

v=a1x+a2y+a3z\vec{v}=a_1\vec{x}+a_2\vec{y}+a_3\vec{z}

Equation 7

A linear combination can be of a single addition, or (as shown in equations 4 above) of any number of additions.

The general notation of a vector by a scalar linear combination will be:

1naivi\sum_{1}^{n}a_i\vec{v_i}

Equation 8

What is the Span?

If v1,v2,..,vnR\vec{v_1}, \vec{v_2},….., \vec{v_n}\in \mathbb{R}
then

the Span of those vectors (sometimes also referred to as the Linear Span) is the set of all possible linear combinations of those vectors.

Mathematically, the span of the set of vectors v1,v2,..,vn\vec{v_1}, \vec{v_2},….., \vec{v_n} is written as:

Sp(v1,v2,..,vn)Sp(\vec{v_1}, \vec{v_2},….., \vec{v_n})

For example:

The three following vectors: v1=[100]\vec{v_1}=\begin{bmatrix} 1\\0\\0\end{bmatrix} , v2=[010]\vec{v_2}=\begin{bmatrix} 0\\1\\0\end{bmatrix} and v3=[001]\vec{v_3}=\begin{bmatrix} 0\\0\\1\end{bmatrix} span any vector in R3\mathbb{R}^3

To prove that, we will take a random vector v=[pqt]\vec{v}=\begin{bmatrix} p\\q\\t\end{bmatrix} and show that it can be generated as a linear combination of of vectors v1,v2\vec{v_1}, \vec{v_2} and v3\vec{v_3} .

In a quick observation we can see that:

v=p[100]+q[010]+t[001]\vec{v}= p\begin{bmatrix} 1\\0\\0\end{bmatrix}+q\begin{bmatrix} 0\\1\\0\end{bmatrix}+t\begin{bmatrix} 0\\0\\1\end{bmatrix}